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Description 

[0001] This invention relates to data encoding and decoding of digital information transmitted over a communication 
channel. In particular, the invention relates to coding and iterative threshold decoding of convolutional self -doubly 
5 orthogonal codes. 

[0002] In modern electronic communications, information is generally transmitted in a discrete digital format. In vari- 
ous applications such as wireless telephonic communications or satellite communications the transmitted information 
signal is susceptible to corruption due to noise in the communication channel (Le, electronic interference in the trans- 
mission medium). To improve transmission reliability and accuracy the prior art discloses channel coding as an error 

10 correcting technique. The two principal error correcting techniques are block and convolutional coding. 

[0003] In convolutional coding, parity bits derived from a span of information bits are added to the information bits for 
redundancy The information bit span length is called the constraint length. Convolutional codes usually operate over 
long streams of information bits, which could be broken into shorter blocks. Whether or not broken into blocks, the 
streams of information bits are encoded in a continuous manner by a simple linear apparatus called a convolutional 

15 encoder. 

[0004] In a basic convolutional encoder, the encoder encodes a stream of information bits by breaking the information 
stream into blocks of N information bits and by performing a logical exclusive-or operation on the most recently received 
N bit block For systematic convolutional encoders, the resulting parity bit from the encoder's calculation is appended 
for redundancy to the information bits before transmission. Therefore, the final transmitted message will consist of the 

20 most recently received information bits and the parity bit output of the logical exclusive-or operation. 

[O0O5] Variations of this simple form includes convolution encoders in which for exannple. the encoder calculates parity 
bits from the most recently received eight bit information block and selected information bits of pervious blocks. The 
encoder's coding rate (i.g. the number of information bits per parity bits) may also be adjusted to improve reliability or 
accuracy of the decoded information. 

25 [0006] Self-orthogonal convolutional codes are specific types of convolutional codes. In self orthogonal convolutional 
code the transmitted parity bits corresponding to each transmitted information bit are generated by the encoder in such 
a way that no two parity equations include more than one symbol in common. As a consequence, for decoding, a simple 
majority rule on the parity equations can be implemented for obtaining an estimate on each received information bit. 
[0007] In order to further improve the reliability of the transmitted data, several techniques based on multi-level coding 

30 and utilizing the serial or parallel concatenation of codes have been developed. Turbo encoding is one such technique. 
Turbo encoding may be regarded as encoding the information sequence twice, once using a first encoder, and then, 
using a second encoder but operating on a scrambled or interleaved version of the same sequence. In principle, any 
number of encoders separated by random interleavers may be used, but the structure is usually limited to two encoders 
with a single interleaver between them. In these techniques the convolutional codes are generally of the recursive sys- 

35 tematic type, that is. the information bits are not altered by the encoding process and are transmitted along the encoded 
accompanying redundant symbols. A key to the improved performance of the Turbo coding technique is that because 
of the interleaving or scrambling between each successive encoder operation, each encoder appears to operate on a 
set of independent information data. 

[0008] As to decoding, convolutional codes may be decoded using the well-known methods of maximum likelihood 
40 sequence estimation techniques such as the Viterbi algorithm. Another well-known decoding technique which is espe- 
cially well suited for self-orthogonal convolutional codes is threshold decoding. Threshold decoding may be imple- 
mented with or without feedback and with a hard or soft quantized input. 

[0009] Generally, decoding of Turbo codes is performed in iterations of two steps. On the first step, the first decoder 
operates on the soft output of the channel pertaining to the code symbols of the first encoder, and provides to the sec- 

45 ond decoder information on the reliability of the decoded sequence. Likewise, the second decoder operates on the 
interleaved version of the estimated information sequence it receives from the first decoder together with a reliability 
information measure on that sequence and its appropriate code symbols. The process is repeated iteratively whereby 
the second decoder feeds back soft output reliability information to the first decoder and the process may be repeated 
anew any number of times. As in the encoding, the interleaving or scrambling allows iterative decoding to be performed 

so over a set of uncorr elated observables. 

[001 0] More specifically, two decoding methods for Turbo Codes have been considered. The symbol-by-symbol Max- 
imum A Posteriori Probability, MAP, algorithm due to Bahl, et al-, "Optimal Decoding of Linear Codes for Minimizing 
Symbol Error Rates". IEEE Trans actions on Information Theory Vol. IT-20, March 1976. and the Soft-Input Soft-Output 
Viterbi decoding algorithm, SOVA. See the specification of U.S. Patent No. 4.81 1.346 and U.S. Patent No. 5.537.444 

55 Both of these decoding algorithms suffer from a rather large computational complexity which prompted the development 
of some simplifying variants. In addition to the decoding complexity Turbo Codes present the further disadvantage of 
an inherent latency or delay which is due to the presence of an interleaver and the number of iterations that are required 
to achieve a given error probability. This delay may be quite large, even unacceptable to many delay-sensitive applica- 
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tions. In some apptications such as encountered in wireless communications for example, both the decoder complexity 
and latency conspire to make the traditional Turbo coding technique unsuitable. 

[001 1 ] The present invention includes a rate 1/2 convolutional encoder for encoding self <loubly orthogonal code com- 
prising: 

a. data converter means for receiving a serial input of information bits and for providing, for each received input 
information bit, a corresponding parallel output of a group of K most recently received information bit through a 
least recently received information bit respectively identified as first through K** information bits; and 

b. self-doubly orthogonal coder means for receiving each group of K information bits, for selecting a sequence of L 
information bits Igt based on generator g; = {go.g1.g2. - .Ql-i} such that for all variations of indices j. k. n, and p 
where 0<j<L, 0<k<j, 0<an<L,0<p<n, n^^k, p<k, except for unavoidable cases the differences of (gj-gk) 
are distinct, the sum of differences (gj - g k + g n " 9p ) distinct, and the differences of (gj-gk) are distinct from 
the sum of differences (gj -g ^ + g □ "gp )' for each group of K information bits a corresponding parallel output 
of L sequence information bits; and 

c. exclusive-or means for receiving each group of L information bits, for generating a parity bit by performing a log- 
ical exclusive-or operation on said L sequence for each received group of K information bits, and for an output of 
parity bit; and 

d. transmitter means for packaging the parity bits and Information bits into coded messages and for transmitting 
these messages through a communication channel. 

[0012] The invention also includes an error correcting decoder for a rate 1/2 convolutional ly self-doubly orthogonal 
codes comprising: 

a. a data receiver means for serially receiving convolutionally self-doubly orthogonal coded messages transmitted 
25 over a noisy medium, and for each received message, a corresponding parallel output of the information and parity 

bits of the received message: and 

b. a rate 1/2 encoder means for serially receiving the received information bits, for storing a group of K most 
recently received bits through a least recently received information bit, for estimating the most recently received 
parity bit from the first through K^*^ information bits by convolutionally self-doubly orthogonal coding the information 

30 bits, arxJ for each group of K information bits, a corresponding serial output of the estimated parity bit; and 

c. an Exclusive-Or means for serially receiving said received message parity bit, for serially receiving said esti- 
mated parity bit. for performing a logical exdusive-or operation on said received message parity bit and estimated 
parity bit. and for each group of received message parity bit and estimated parity bit, a coresponding serial output; 
and 

35 d. a syndrome means for serially receiving said serial output of the Excluslve-Or means, for storing a group of K 
most recently received through least recently received output bit of said Exclusive-Or means, for each group of K, 
selecting a group of J bits according to code generators, and for each group of K stored bits, a corresponding par- 
allel output of the J selected bits; and 

e. a threshold logic means for receiving said group of J parallel outputs from said syndrome means, for summing 
40 said J inputs, for comparing the sum to a preset threshold, and for each group of J inputs a corresponding serial 

output of the comparison; and 

f. an error correcting means for serially receiving the output of the threshold logic means, for error correcting the 
most recently received message information bit by inversion, and for error correcting the outputs stored in said syn- 
drome means by inversion, 

45 g. m subsequent stages, each stage comprising a syndrome means, a threshold logic means, and an error correct- 
ing means, such that each stage operates on the error corrected output of the previous stage; and 
h. in which said syndrome means in each subsequent stage selects a subset of the sequence selected, in which 
the preset threshold of the threshold logic means of each stage is greater than or equal to the preset threshold of 
each subsequent stage. 

50 

[001 3] An object of the present Invention is to provide an improved encoder and decoder based on using convolutional 
self doubly orthogonal codes together with iterative threshold-type decoding and to provide novel iterative encoders and 
decoders for convolutional codes without increased complexity and latency caused by interleaving. 
[0014] Another object is to provide iterative hard or soft quantized decoders based on Turbo decoders without inter- 
55 leaving or scrambling, and an iterative feedback decoder for convolutional codes with error propagation constrained by 
the coding scheme and weighing of feedback decisions. 

[001 5] The present Invention will now be described by way of example, with reference to the accompanying drawings 
In which: 
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Figure 1 is a block diagram illustrating, in a embodiment, a convolutional encoder for generating convolutional self- 
doubly orthogonal codes. 

Figure 2 is a block diagram illustrating, in an embodiment decoder for decoding convolutional setf-doubly orthogo- 
nal codes. 

5 Figure 3 is a block diagram illustrating, in an embodiment, a threshold decoder for decoding convolutional self<lou- 

bly orthogonal codes. 

Figure 4 is a block diagram illustrating, in an embodiment, a decoder for decoding convolutional self-doubly orthog- 
onal codes. 

10 [0016] For Viterbi-like iterative decoding of convolutional codes (Lg., Turbo Decoding), an interleaver is used to insure 
that decoding is applied on different independent sets of observables. To obtain the same effect without interleaving for 
iterative threshold decoding, Convolutional Self Doubly Orthogonal Codes are implemented. 

[001 7] Figure 1 illustrates in block diagram form an embodiment of a convolutional self-doubly orthogonal encoder of 
the present invention. FIG. 1 illustrates a convolutional self-doubly orthogonal encoder 30 is of a constraint length K. 
15 [0018] In FIG. 1 , shift register 12 receives a serial stream of information bits It- Upon each clock pulse, the self-doubly 
orthogonal coder 1 3 receives a parallel output of the most recent Ik-i to the K-1 least recent information bits Iq from shift 
register 1 2. 

[0019] The self-doubly orthogonal encoder 13 selects a subset L of the K information bits in a sequence that meets 
the definition of convolutional ly self-doubly orthogonal codes. 
20 [0020] A convolutional code of rate 1/2 is convolutionally sell-doubly orthogonal code, if for all of the following combi- 
nation of indices: 



0<j<J,0<k<j,0<n<J,0<p<n,n9tk,p<k 



1) the differences of generators. (gj-giJ. are distinct, 

2) the sum of differences, (g j-g k + 9 n ' 9p ). are distinct and 

3) the sum of differences are distinct from the differences. 

30 [0021] The exclusive-or gate 14 receives the parallel stream of the selected sequence of information bits generated 
by the self-doubly orthogonal encoder 13. The exclusive-or (XOR) gate 14 performs a logical exclusive-or operation on 
the L selected information bits, thereby generating a parity bit output P. Transmitter 15 receives the parity bit outout from 
the exclusive-or gate and the most recent input information bit. 

[0022] Transmitter 15 packages the parity bit and the information bit into coded messages and transmits these mes- 

35 sages through a communication channel. 

[0023] The self-doubly orthogonal encoder 1 3 may also select a subset L of the K information bits in a sequence that 
nr>eets the definition of convolutionally self-multiply orthogonal codes. In such encoders the encoder generates further 
sequences such that for all variations of W pairs of additional indices q,j and r^ where 1 < u < W. 0 < q^ < L, 0 < r^ < qu, 
n ^ qu ^ k. fu < p < k, except for unavoidable cases, the differences of gp for each pair of indices q^ and r^. (gq - gr) are 

40 distinct, the sum of differences (gj-gk + gn-gp)are distinct, the sum of differences 

w 

u=1 

45 

are distinct, all sums of differences are distinct from all differences, and all the differences are distinct from each other. 
[0024] Figure 2 illustrates an embodiment of a hard quantized convolutional self-doubly orthogonal decoder. The con- 
volutional self-doubly orthogonal decoder 50 of FIG. 2 illustrates an emtx)diment of a hard iterative threshold decoder 

so for rate 1/2 convolutional self-doubly orthogonal codes. Data receiver 21 receives messages transmitted through a 
communication channel The data receiver 21 detects and divides the message into its parity and information compo- 
nents. The convolutional self-doubly orthogonal encoder 22 receives the most recently received information bit Tk-i 
from the data receiver 21 . The convolutional self-doubly orthogonal encoder 22 is essentially the encoder of FIG. 1 . The 
encoder 22 estimates the transmitted parity bit by convolutionally self-doubly orthogonal encoding the received infbr- 

55 mation bits thereby estimating the received parity bit. The shift register 23 receives the stream of received parity bits 
from the data receiver in a FIFO register. The exclusive-or gate 24 receives the estimated convolutional self-doubly 
orthogonal code parity bit and the received convolutional self-doubly orthogonal code parity bit from the shift register 
23. The exclusive-or gate 24 performs a logical exclusive-or operation on the estimated and received parity bits. 
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[0025] The first threshold decoder stage 26 receives the output of the exclusive-or operation of the exclusive-or gate 
24 (i.g., the syndrome bits) and the least recently received information bit Ik- 

[0026] Figure 3 illustrates an embodiment of a threshold decoder stage 26. In Figure 3. the threshold decoder stage 
26 is comprised of a shift register with additional logic 41 , selector 42, threshold logic apparatus 43. exclusive-or gate 

5 44, and a syndrome correction selector 45. Shift register with additional logic 41 essentially stores the most recent to 
the least recent results of the exclusive-or gate 24 with the possible inversion of some of these results. The shift register 
46 receives the most recently received information bit and stores the information bit in a K-bit FIFO register, thereby 
storing the most recently to the Kth least recently received information bits. The exclusive-or gate 44 of the threshold 
decoder stage 26 receives the least recently received information bit and the output of the threshold logic apparatus 43. 

10 [0027] The selector 42 selects a set of the bits stored in shift register with additional logic 41 according to the inversion 
of the convolutionat self-doubly orthogonal code generation. Selector 42 selects all or a subset of the syndrome bits 
stored in the shift register with additional logic 41 . The selected syndrome bits were directly calculated from parity bits 
which were derived in part from the least recently received information bit. The threshold logic apparatus 43 receives 
the selected syndrome bits from the selector 42 and performs a threshold logic summing operation on the received syn- 

15 drome bits. The threshold value of the threshold logic apparatus 43 is preset for each threshold decoding stage 26. If 
the sum of the syndrome bits is below the preset threshold of the threshold logic apparatus 43, an error correcting signal 
is initiated to invert the least recently received information bit of the threshold decoding stage 26 and to activate the syn- 
drome correction selector 45 of the threshold decoder stage 26. When activated, the syndrome correction selector 45 
selects the proper syndrome bits of the shift register with additional logic 41 to be inverted. These bits to be inverted 

20 are identical to those selected by selector 42. The threshold decoder stages can be implemented as separate identical 
stages each operating on the error corrected output of the previous stage in order to error correct the received infbrnna- 
tion bit. The stages can also be implemented as one unit which iteratively error corrects the received information bit 
based on previous error correcting iterations. In each stage or iteration, variations in the set of selected syndrome bits 
which are selected based on the inversion of the encoder and the preset threshold can increase the accuracy of the 

25 decoder. For example, the syndrome bits are selected in relation to the preset threshold value such that the number of 
bits in each selected subset is proportional to a decrease in the threshold. The iterations or stages are terminated 
based on application specific limiting conditions such as decoder complexity, latency and target error performance. 
These limiting conditions require engineering design for each application. 

[0028] Figure 4 illustrates an ennbodiment In block format of another embodiment of a convolutional self-doubly 
30 orthogonal decoder 60. The basic embodiment of figure 4 is comprised of a receiver 61 , a storage device 62, a decod- 
ing unit 63, and a terminator 64. The receiver 61 receives the message transmitted through a noisy channel and sepa- 
rates the message into its information and parity bit components. The storage device 62 receives and stores in 
selectably accessible locations the stream of received information and parity bits from the receiver 61 . The decoding 
unit 63 estimates the transmitted information bits from the inversion of the parity equation of the transmitted message 
35 based on received information and parity bits and estimated information and parity bits. The terminator 64 terminates 
the iterations of the decoding unit based on application specific limiting conditions such as decoder complexity, latency 
and target error performance. These limiting conditions are complex and require engineering design for each applica- 
tion. 

[0029] The decoding unit 63 essentially implements the inversion of the parity equation for transmitted convolutionat 
40 self-doubly orthogonal code. For example, for rate M2 systematic convolutional self-orthogonal codes for threshold 
decoding, encoding consists of generating a parity bit Pj for each Information bit Ij to be transmitted at time, i, i=0,1 ,2,..., 
where the parity bit is a function of the current bit and of the J-1 previous bits: 

ey=o 



where the sum is taken modulo-2, as denoted by the 0 symbol, with bit values +1 or-1 , where +1 corresponds to the 
50 usual zero bit. The J values of gj specify the convolutional self-orthogonal code being used (e.g., convolutional self-dou- 
bly orthogonal code), and forms a difference set that is. their differences are distinct. 

[0030] The decoding process consists of inverting the J parity equations associated with each information bit by using 
only the sign of the received bit values. The received value and each parity equation generate (J4-I) estimates and a 
weighted combination of these estimates produces the maximum a posteriori probability "MAP" value of the decoded 
55 bit. The weighing values can be determined according to the amplitude of each received symbol These estimates may 
be approximated by the introduction of an add-min operator, denoted by the same symbol 0. which produces the same 
modulo-2 addition on the sign of the operands but with an amplitude value equal to the minimum of the absolute values 
of the operands, that is, x®y=sign(x)sign(y)min(|x|,|y|) . The approximated MAP decoder then consists in producing a 
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deccxJed bit, Tj, according to the following expression: 

J-1 J-1 / J-1 



/=o j=o^ e/f=o./c+/ ^ 



where l®j j are the J estimates obtained through parity-check equation inversion, and where the outermost sum is the 
usual sum on real numbers. The received information and parity bit streams which were transmitted over an Additive 
White Gaussian Noise, AWGN, channel are denoted as Ij and Pj respectively. 
10 Calculating the Log-Ukelihood Ratio, LLR, is simple since the observables in this expression are all independent or 
equlvalently each Gaussian random variable 

15 

appears only once in the equation for a given i. 

[0031] In the usual feedback form of threshold decoding, when gj-g^ is smaller than zero, the past decoded bits are 
used instead of the received symbol. Hence the decoder equation may be written as: 

20 J-1 /-I J-1 X 

7=0 7=0^ e/f=0 «/f=y+1 ^ 



25 where the generator values gj are assumed to be increasing with j. These past decisions T are considered close to error- 
free. However, they are in fact random variables which should be treated as dependent random variables. 
[0032] Iteratively applying equation (1 ) with a gain smaller than 1 for the estimates generated by the parity the inver- 
sion equation produces the following result: 

30 j-l y.1 j-i >^ 

r=/,+a '"•>2:'tr='--^ ^""Z P/.s,® Z O Z 'CrJ (2) 

7=0 7=0^ e/c=0 efr=7+1 ^ 



35 where the gains a^"^^ serve the same purpose as the thresholds above. To obtain a more flexible arrangement, we may 
insert the gains in the outer sum and then adjust them individually for each estimate and add an overall gain on the 
received information sequence: 



J-1 




45 

[0033] For Viterbi-like iterative decoding of convolutional codes, an interleaver is used to insure that decoding is 
applied on independent sets of observables. To obtain the same effect without interleaving, apply equation (2) recur- 
sively to the transmitted convolutional self -doubly orthogonal code for the first two decoding steps, that is m=1 and m=2. 
For m=2 the results of the second step may be written as: 

50 



55 
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50 



55 



3(2) 



r 1 ^ 1 ^ (1) 

^ n=0,cond(n) ep=0 ep=n+1 



(3) 



where the past decisions of each decoding step has not been expanded into its channel symbol constituents. These 
decisions are assumed to be error-free as compared with the channel symbols with which they are combined by the 
add-min operator A condition on n is added on the 4*^ summation of (3), this condition is needed for a strict MAP esti- 
mate. To obtain equation (3) as a function of independent observables. we observe that the terms (gj-gk+9n'9p)» 
(9 j-9 k+9 n ) (9j"9k) need to be distinct for all the valid combinations of Indices, that is: 0 < j < J, 0 < k < j, 0 ^ n < J, 
0 < p < n, n k, p < k. This is however impossible without a further condition on n, since gk may be equal to gp or also 
since gk and Qp nnay be permuted. The condition may only be on n or else the parity equation Inversion becomes invalid. 
A condition on n only implies that not all estimates of the previous decoder are used for the current decoding. A neces- 
sary condition would then be n<k Other conditions on n depending on the complexity, the error propagation character- 

20 Istlcs, and proportion of dependent variable over all the observables may also be implemented. 

[0034] An encoder and decoder for generating and decoding convolutional codes of Improved orthogonality. In an 
exemplary embodiment the encoder includes a K-bIt length shift register for receiving an input serial stream of informa- 
tion bits and providing for each Input bit a K-bit parallel output to a sell-doubly orthogonal code sequence generator. The 
encoded symbol stream is threshold decoded iteratively using the inversion of the convolutional self-doubly orthogonal 

25 parity code generators. 

Claims 

1. A rate 1/2 convolutional encoder for encoding self-doubly orthogonal code comprising: 

30 

a. data converter means for receiving a serial input of information bits and for providing, for each received input 
information bit. a corresponding parallel output of a group of K most recently received information bit through 
a least recently received information bit respectively identified as first through K*^ Information bits; 

b. self-doubly orthogonal coder means for receiving each group of K information bits, for selecting a sequence 
35 of L Information bits Ig^ based on generator gi = {go.9i.92 9l-i} ^^<^^ ^^^^ 3" variations of indices j, k. n. 

and p where 0^j<L, 0<k<j, 0<n<L, 0<p<n,n5£Kp<k, except for unavoidable cases the differences 
of (9j ■ 9k) sre distinct, the sum of differences (gj-gk + gn"9p)are distinct, and the differences of (gj - giJ 
are distinct from the sum of differences (gj-gk + 9n"9p)' ^"^1 for each group of K information bits a corre- 
sponding parallel output of L sequence information bits; 
40 c. exclusive-or means for receiving each group of L information bits, for generating a parity bit by performing a 

logical exclusive-or operation on said L sequence for each received group of K information bits, and for an out- 
put of parity bit; and 

d. transmitter means for packaging the parity bits and information bits Into coded messages and for transmit- 
ting these messages through a communication channel. 

45 

2. A rate 1/2 convolutional encoder of claim 1 , wherein said self-doubly orthogonal generator means further generates 
sequences such that for all variations of W pairs of additional indices qu and r^J where l^u^W, 0<qu<L, 0<ru 
< qy, n 9t q^ k , r^ < p < k, except for unavoidable cases the differences of gp for each pair of Indices qu and r^, (gq- 
Qr) are distinct, the sum of differences {g|-gn + gn-gp)are distinct, the sum of differences 



are distinct, all sums of differences are distinct from all differences, and all the differences are distinct from each 
other, In which said data converter means comprises a shift register having a data input, a clock input and K register 
stages each with a corresponding stage output. 
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3. A rate 1/2 convolutional encoder as claimed in claim 1 or 2 wherein said self -doubly orthogonal generator means 
comprises a shift register having L stages and a clock input. 

An error correcting decoder for a rate 1/2 convolutionally self-doubly orthogonal codes comprising: 

a. a data receiver means for serially receiving convolutionally self<loubly orthogonal coded messages trans- 
mitted over a noisy medium, and for each received message, a corresponding parallel output of the information 
and parity bits of the received message; and 

b. a rate 1/2 encoder means for serially receiving the received information bits, for storing a group of K most 
recently received bits through a least recently received information bit, for estimating the most recently 
received parity bit from the first through K*^ information bits by convolutfonally self-doubly orthogonal coding 
the information bits, and for each group of K Information bits, a corresponding serial output of the estimated 
parity bit; 

c. an Exclusive-Or means for serially receiving said received message parity bit. for serially receiving said esti- 
mated parity bit, for performing a logical exclusive-or operation on said received message parity bit and esti- 
mated parity bit, and for each group of received message parity bit and estimated parity bit. a corresponding 
serial output; 

d. a syndrome means for serially receiving said serial output of the Exclusive-Or means, for storing a group of 
K most recently received through least recently received output bit of said Exclusive-Or means, for each group 
of K, selecting a group of J bits according to code generators, and for each group of K stored bits, a corre- 
sponding parallel output of the J selected bits; 

e. a threshold logic means for receiving said group of J parallel outputs from said syndrome means, for sum- 
ming said J inputs, for comparing the sum to a preset threshold, and for each group of J inputs a corresponding 
serial output of the comparison; 

f. an error correcting means for serially receiving the output of the threshold logic means, for error correcting 
the most recently received message information bit by inversion, and for error correcting the outputs stored in 
said syndrome means by inversion, 

g. m subsequent stages, each stage comprising a syndrome means, a threshold logic means, and an error cor- 
recting means, such that each stage operates on the error corrected output of the previous stage; and 

h. in which said syndrome means in each subsequent stage selects a subset of the sequence selected, in 
which the preset threshold of the threshold logic means of each stage is greater than or equal to the preset 
threshold of each subsequent stage. 

5. An error correcting decoder as claimed In claim 4 wherein, in each stage of said error correcting decoder, the 
35 number of bits in each selected subset in the syndrome means is proportional to a decrease in the threshold in the 
threshold logic means, and said en-or correcting decoder further comprising an amplitude measuring means for 
measuring amplitudes of received messages and conditioning means for weighing the inputs of the Exclusive-Or 
gate based on the measured amplitudes. 

40 6. An error correcting decoder as claim in claim 4, wherein said syndrome means further comprising: 

a. a sequence selector means for selecting J of the K outputs of said Exclusive-Or means such that each 
selected output Sj was derived from all of the K information bits which directly affected coding of the received 
parity bit P, and said error correcting decoder further comprising condition means for limiting the number of 
45 Stages. 

7. An error correcting decoder for convolutionally self-doubly orthogonal code comprising: 

a. a data receiver means for serially receiving convolutionally self-doubly orthogonal coded messages trans- 
50 mitted over a noisy medium, and for each received message, a corresponding parallel output of the information 

(I) and parity (P) bits of the received message, 

b. an accumulator for serially receiving said information and parity bits from said data receiver, for storing a 
group of K most recently received information and parity bits through a least recently received information and 
parity bits, for providing selectable access to stored bits, and for an output of selected bits: 

55 c. an iterative threshold decoding and error correcting means for selectably accessing the stored bits in said 

accumulator, for each iteration estimating the least recently received information bit based on inversion of the 
parity equation of the received message, said inversion equation operating on the most recently received I bits, 
the most recently received P bits, previously received P bits, a preset sequence of previously received I bits. 
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and estimates of previously received I bits, for each iteration a threshold comparison of the estimated informa- 
tion bit and the received bit. 

8. An error correcting decoder as claimed in claim 7,said iterative threshold decoding and error correcting means fur- 
ther comprising a decorrelator means for conditioning the operation of the parity inversion equation based on the 
log likelihood or an approximation of the log likelihood of said information in which the iterative threshold decoding 
and error correcting means further comprising a weighing means for measuring the received amplitudes of the K 
stored messages, and for weighing the values of previously received information and parity bits in the operation of 
the parity inversion equation. 

9. An error correcting decoder as claimed in claim 8, wherein said iterative threshold decoding and error correcting 
means further comprising a balancing means for adjusting said weights according to the number of iterations, and 
said en-or correcting decoder further comprising an amplitude measuring means for measuring the amplitude of 
received message bits and weighing means for weighing iteration estimates of said iterative threshold decoding 
and error correcting means based on the measured amplitudes of the bits under consideration, including the itera- 
tive threshold decoding and error correcting means further comprises a condition means for conditioning each iter- 
ation of the parity inversion equation based on the log likelihood or an approximation of the log likelihood of said 
information. 

10. An encoder comprising a convolutonal self-doubly orthogonal encoder for coding rate b/v, 1 < < v, v = 2, 3, 4 

where b parallel information is input to b data converter means and where (v-b) convolutional self-doubly orthogo- 
nal parity bits are generated. 

11. A decoder comprising an iterative threshold decoder of convolutional self-doubly orthogonal code for coding rates 

b/v, 1 < b < V, v = 2, 3. 4 where b parallel information and (v-b) convolutional self-doubly orthogonal encoded 

parallel parities are rteratively threshold decoded generating b parallel decoded bits. 
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